IIT Kharagpur at TAC 2009: Statistical and Nugget-based Model for Automatic Summary Evaluation
نویسندگان
چکیده
In this paper we present our participation at TAC 2009 AESOP (Automatically Evaluating Summaries Of Peers) task. We make use of a statistical model for evaluation metric correlating to Overall Responsiveness and a nugget-based pyramid model for correlating to the Pyramid manual metric of TAC 2009. We also present the performance of our three submitted runs as per the official TAC 2009 evaluation results.
منابع مشابه
IIT Kharagpur at TAC 2008: Statistical Model for Opinion Summarization
In this paper we present our participation at TAC 2008 opinion summarization task. We make use of a statistical model for opinion extraction and the subsequent summarization of the extracted opinions. We also present its performance as per the official TAC 2008 evaluation results.
متن کاملICON - 2008 6 th International Conference on Natural Language Processing
A system of machine translation under the framework of transfer-based grammar for Indian languages needs a set of rules for mapping the several syntactic as well as semantic facts of a source language on to the target language representations. Among these critical syntactico-semantic facts, this paper tries to approximate linguistic conditions for mapping rules for Hindi postposition transfer t...
متن کاملEnhancing N-Gram-Based Summary Evaluation Using Information Content and a Taxonomy
In this paper we propose a novel information-theoretic metric for automatic summary evaluation when model summaries are available as in the setting of the AESOP task of the Update Summarization track of the Text Analysis Conference (TAC). The metric is based on the concept of information content operationalized by using a taxonomy. Hereby, we present and discuss the results obtained at TAC 2009.
متن کاملA Multi-Objective Method for Network Reconfiguration (TECHNICAL NOTE)
This paper presents an algorithm based on multi-objective approach for network reconfiguration. Multiple objectives are considered for reduction in the system power loss, deviations of the nodes voltage and transformers loading imbalance, while subject to a radial network structure in which all the loads must be energized and no branch current constraint is violated. These three objectives are ...
متن کاملThomson Reuters at TAC 2009: ContextChain and Fractional Conditional Compressibility of Models
This paper contains the results for the FastSum system and a simple baseline system for the TAC 2009 main task – update summarization –. For the pilot task of Automatically Evaluating Summaries of Peers (AESOP), we present two novel metrics. The first metric called ContextChain is an extension of a recently proposed metric AutoSummENG that is based on comparing n-gram graphs of the model summar...
متن کامل